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1. Introduction 



As emphasized in |37| the study of noncquilibrium stationary states, i.e. the 
states of systems maintained far from equilibrium by suitable forces and/or reser- 

■ voirs has seen some progress in the last few years. Unlike in equilibrium statistical 
mechanics, nonequilibrium stationary states are not given by some apriori formula, 

■ and therefore the construction of the stationary states and the study of their prop- 
\ erties require in general a thorough understanding of the dynamics. Furthermore 

exactly solvable models (for example linear ones |34L I39p have pathological trans- 
port properties, and this makes the study of nonlinear dynamics even more nec- 
^ ■ essary. There are several ways to model reservoirs: by thermostats modeled by 

deterministic forces, see e.g 16, 35 , by stochastic reservoirs modeled by suitable 
random forces, see e.g. and by Hamiltonian reservoirs where the reservoirs are 
\ Hamiltonian systems. The last choice is perhaps the most natural and fundamental 

one, but each of the approaches involves some idealization and all of them should 
be in some (yet unknown) sense equivalent. 

We consider here a class of systems (finite lattice of anharmonic oscillators) 
interacting, at the boundaries only, with Hamiltonian reservoirs described by free 
phonon fields. A series of rigorous results has been obtained for such systems 
|1UL IllL IHl I3UI 1311 1321 118L existence and uniqueness of the stationary state, 
exponential rate of convergence, positivity of entropy production and study of its 
fluctuations (Gallavotti-Cohen Theorem). These results are the most complete ones 
obtained up to date for a (boundary driven) Hamiltonian system with a nontrivial 
(i.e. nonlinear) dynamics (see also e.g. jl3L II 7L |4] for classical systems and |36L 
121) quantum systems). But several basic and fundamental problems remain very 
poorly understood both at the physical and mathematical levels, such as deriving 
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the transport properties of such systems, for example the Fourier's Law of heat 
conduction (see e.g. the reviews [2 ^ I24| and references therein). 

In Section [3 we describe a model of a Hamiltonian reservoir at positive tem- 
perature. We also describe how to choose a coupling with the system in such a way 
that one can reduce the infinite-dimensional Hamiltonian dynamics to a Markovian 
dynamics on a finite-dimensional phase space. 

In Sectional we consider a chain of oscillators connected to two reservoirs at 
different temperatures and present our results on the ergodic properties of such 
systems. We present some conceptual ideas behind the proofs: the analysis of dissi- 
pation and fluctuations, the construction of Liapunov functions for the dynamics , 
and the role of breathers as (possible) obstacles to the existence and/or exponential 
relaxation of the stationary state. 

In Section 01 we study the properties of the entropy production: positivity, 
fluctuations (Gallavotti-Cohen theorem [121 UHl 1231 EHj), connection with 
time-reversal, Green-Kubo formula. 

In SectionOconsider stochastic reservoirs modeled by Langevin equations. Our 
techniques apply to these systems too and we consider higher-dimensional lattice 
for which similar results as in Sections (31 and 01 can be sometimes proved. 

We would like to thank Jean-Pierre Eckmann, Martin Hairer, Joel Lebowitz, 
Claude- Alain Pillct, and Lawrence E. Thomas for their collaboration, suggestions, 
and discussions. 



2. Markovian Heat Reservoirs 

It is customary to model the interaction of a mechanical system reservoirs by 
adding suitable random forces (stochastic reservoirs), and it is often done in such a 
way as to obtain a Markovian dynamics. In general the dynamics of a mechanical 
system interacting with a Hamiltonian reservoir is not Markovian: there are always 
memory effects. In certain cases one can obtain a Markovian dynamics by taking 
a suitable limit (see e.g. |14L O \38\ ). but in this section, we show how to obtain 
a Markovian dynamics by choosing a particular coupling with the reservoir. The 
dynamics of the system is not Markovian, but one can make it Markovian by adding 
finitely many auxiliary variables. Equations similar to those we derive do appear 
in 33 but, to our best knowledge, their derivation appear first in jlOl 31 . For 
simplicity we consider a single particle coupled to one reservoir. 

The reservoir is a free phonon gas described by a linear wave equation in R''. 
Let 0(a;) = {(f{x),TT{x)), x G R'^, be a pair of real fields, let ||0|| be the norm given 
by ||<^||^ = J dx {\\7(f{x)\'^ + |7r(x)p), and let us denote (•, •) the corresponding 
scalar product. The phase space of the reservoirs at finite energy is the real Hilbert 
space of functions 4'{x) such that the energy HB{(j)) = ||</'|P/2 is finite and the 
equations of motion are 

(1) 4>{t,x) = C(p{t,x), £ = 

Reservoirs at positive temperature T are described by Gibbs measure at tempera- 
ture T, vt, given (formally) by 

(2) Md^,dTT) = Z-^exp f-^ I dx(|V^(a;)p + |7r(a;)p)') \ld4>{x)d^{x) . 



ill 
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This expression is formal, but the measure vt is simply the product of a Wiener 
measure times a white noise measure. Its covariance is r(-, •). We will construct the 
stationary states by assuming that, at time t = 0, the reservoirs initial conditions 
are distributed according to the Gibbs measure vt- 

The Hamiltonian of the particle is Hs{p,q) — + V(q), where {p,q) G 

j^d ^ j^d^ ^j^^ Hamiltonian for the coupled system particle and reservoir we 

take (dipole approximation) 

(3) Hi^,p,q) = ^U\\^+p^ + V{q)+q- JdxVcp{x)p{x) 

= HBi<P)+Hsip,q)+q-{^,a), 

where p{x) is a real rotation invariant function and a — (a^^-* , • ■ ■ , a'-''-' ) is, in Fourier 
space, given by d^'-' (fc) ~ (O, —ik^^^ p{k)/k^) . Let us introduce the covariance matrix 
\exp ). A simple computation shows that 

(4) C'^'^\t) - ij,, J dfc|p(fc)pe'l^-|(*-«), 

and we define a coupling constant A by putting = C("'(0) = 3 / dk\p{k)\'^. The 
equations of motion of the coupled system are 

m = p{t), 

(5) p{t) = -VV{q{t))-{cj,,a), 
Ut,k) = C{(l){t,k)+q{t)-a{k)) . 

With the change of variables V-'(fc) = 4>{k) + 9 " <^{k), Eqs. |SJ become 

m - p{t), 

(6) p{t) = -VVMt))-{^,a), 
ip{t,k) = C'ijj{t,k) +p{t) ■ a{k) , 

where T4ff(g) = V{q) — \'^q^ /2. Integrating the last of Eqs. ® with initial condition 
^o(fc) one finds 



(7) ^l;{t,k) = e^'Mk)+ ds e'^^*~''> a{k) ■ p{s) , 

Jo 

and inserting into the second of Eqs. © gives 



m = Pit), 



(8) Pit) = -VVMt))- dsC{t~s)p{s)~{'iPo,e-^*a) 





Our assumption on the initial condition of the reservoirs imply that the force 
^{t) — {ipo, e^^^a) is a d-dimensional stationary Gaussian process with mean and 
covariance TC{t — s). Note that the covariance itself appears in the deterministic 
memory term on the r.h.s. of Eq.ljS)) (fluctuation-dissipation relation). 
We choose the coupling function p such that 

(9) \kf''\p{k)\' = Pik^)-\ 
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where P is a polynomial. As a consequence there is a polynomial p{u) which is a 
real function of iu and has its roots in the lower half plane such that 

/OO 1 

Note that this is a Markovian assumption ISl: for such couplings £,{t) is a Markovian 
Gaussian process: p{—id/dt)^{t) = where uj{t) is a white noise. For simplicity 
we will take P{k^) — C{k'^ + 7^) and then is an Ornstein-Uehlenbeck process; 
other polynomials can be treated similarly. This assumption together with the 
fluctuation-dissipation relation permits, by extending the phase space with one 
auxiliary variable, to rewrite the integro-differential equations lO as a Markov 
process. We have C^"-'(t) ~ A^e^'''*' and introducing the variable r defined by 

(11) Xr{t) = f dsCit-s)p{s)+^{t), 

Jo 

we obtain from Eqs.JHl) ^^t of Markovian differential equations: 

(12) m - -VVMt)) - Xr{t) , 

dr{t) = {^-fr(t)+Xp{t))dt+{2Tjy/^duj{t). 

The dynamics of (jj(t), q{t),r{t)) is Markovian, and similar equations may be ob- 
tained for any polynomial P. 

3. Ergodic properties: the chain 

Let us consider a chain of n anharmonic oscillators given by the Hamiltonian 

n 2 

Hs{p,q) - ^^-HFCZl,-- - ,'?«), 

n 71—1 
V{q) = ^[/(l)(g,) + ^[/(2)(5,-g,,^i). 

i=l i=l 

Our assumptions on the potential V{q) are 

HI Growth at infinity: The potentials U'^^^x) and U'^^^x) are C°° and grow at 
infinity like \\x\\'''^ and llxll*^^: There exist constants Ci, Di, i — 1,2 such that 

(13) lim X-'^'U^'HXx) = a^'^Wxf^ , 

A — >oo 

(14) lim X-'''+^VU^'\Xx) = a^'h,\\xf^~^x, 

A^oo 

(15) Wd^U^'Hm < {Q+D,V{x))'-^ . 

where |j • || in Eq. IjlSfl denotes some matrix-norm. 
Moreover we will assume that 

(16) k2 > h>2, 

so that, for large ||a;|| the interaction potential [/'■^■' is "stiffer" than the one-body 
potential U^'^l 
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H2 Non-degeneracy: The coupling potential between nearest neighbors C/*^^^ is 
non-degenerate in the following sense. For x G R*^ and m — 1, 2, • • • , let A''™-\x) : 
R*^ R"* denote the linear maps given by 

am+lTT{2) 

We assume that for each x £ R'^ there exists toq such that 

(18) Rank(A(i)(x),---A("'')(a;)) ^d. 

For example any confining polynomial potential of even degree satisfy assump- 
tions HI and H2. 

We couple the first and n*^ particle each to one reservoir at temperatures Ti 
and Tn respectively. We assume that the couplings to be as in Section 13 so that, 
by introducing two auxiliary variables ri and r„, we obtain the set of stochastic 
differential equations equations 

qi Pi, 

Pi = -Vg,V{q)-Xri, 

dri = {--iri+Xpi)dt + {2Ti-iY''^doJi, 

= Pj , j = 2, . . . , n - 1 , 

(19) pj = -Vg^Viq), j = 2,...,n-l, 

Qn = Pn, 

Pn = -Vg„y((7) - Ar„ , 
drn = (-7'''n + Ml) d-t + (2r„7)^/^dw„ . 

The solution x{t) = {p{t), q{t),r{t)) of Ea. ((T^ is a Markov process. We denote T* 
as the associated semigroup, 

(20) T'f{x) = E4fixit)], 
with generator 

(21) ^ = H 7(Vr.rVr. -r^V^J -h A(kV^. -r^VpJ 

ie{l,n} 



-(^9.^(9))Vp 



and Pt{x, dy) as the transition probability of the Markov process x{t). There is a 
natural energy function which is associated to Ea. p9|l . given by 

(22) G(p,g,r) = ^ + i7(p,g), 

and a straightforward computation shows that at equilibrium (i.e., if Ti = T„ = T) 
the Gibbs measure exp {~G{p, q, r)/T) is an invariant measure for the Markov 
process x{t). 

The function 

(23) We = exp(6'G) 
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will be used repeatedly. We denote as 

by 

(24) \Ae 



the weighted total variation norm given 



sup 

\f\<We 



fdn 



for any (signed) measure tt. We introduce norms 

by 

1/(^)1 



and Banach spaces Tig given 



(25) 



ll/l 



x<£X We[x) 



He = {f : \\f\\e<^}.. 



and write H^He for the norm of an operator K : Tig Tig. 

Our results on the ergodic properties of Eqs. H19() are summarized in 

Theorem 3.1. : Ergodic properties 

(a) The Markov process x{t) has a unique invariant measure fi. The measure fi is 
ergodic and mixing and has a C°° everywhere positive density. 

(h) For any 6 with < 6 < (maxjTi, Tfi})^^ the semigroup T* : Tig — > Jig is 
compact for all t > 0. In particular the process x(t) converges exponentially fast to 
its stationary state pi: there exist constants r = r{9) > 1 and R = R{9) < oo such 
that 

(26) \Pt{x,-)-ti\g < Rr-'Wg{x), 

for all X € X . Furthermore for all functions f , g with G Tig and all t > 

we have 



(27) 



gT*f dn- fd^ gdu 



< Rr-'\\f 



(exponential decay of correlations in the stationary state). 

There are essentially two proofs of Theorem 13.11 which follow quite different 
strategies. The (chronologically) first one |11L 1311 [32j is probabilistic and is based 
on a detailed analysis of the dynamical effects of dissipation and fluctuations. The 
second proof TO, 8, 18', |S] is purely functional- analytic and use global hypoelliptic 
estimates on the generator L. In our opinion the first approach has the advantage 
to be a little simpler and also to display better the dynamical mechanisms at play. 
It singles out the breathers as a (possible) obstacle to the existence of a stationary 
state. The second approach has the advantage to be a bit more constructive and so 
it gives more precise information on the location of the spectrum. We sketch the 
main steps of the proof of Theorem 13. II following the probabilistic approach taken 
in [TniMll32] . 

Hypoellipticity: The first thing to realize is that the generator L is hypoelliptic. 
The operator L has the form L = X^jli -^j + -''^o where the Xi are smooth vec- 
tor fields which satisfy the following Hormander-type condition: the vector fields 
{Xj}j>i; {[Xi, Xj]}ij>o] {[[Xi, Xj]Xk]}i,j^k>o; ■ ■ ■ span the whole tangent space at 
every point x. This implies |19L .20, 2^ that the the transition probabilities have 
a smooth density. 

Control theory and Uniqueness: The uniqueness of the invariant measure is 
obtained with a control-theoretic argument. Using the Support Theorem of |41| . 
one study the following control problem: replace in Eqs. 1)1911 the (rough) white 
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noise uj{t) by a smoother (e.g. piecewise smooth) control. The Support Theorem 
asserts in particular that the support of the transition probabilities Pt{x, dy) is the 
same as the closure of the set of all points reachable in a time t starting from x 
with a smooth control. One can show (11) that for all t and for all x the transition 
probabilities have full support. This is achieved done by an explicit construction of 
the possible controls which drive the system from x to y in a given time span. This 
controllability property together with the smoothness of the transition probability 
imply that there is at most an invariant measure. 

Liapunov functions, Existence, and Compactness: The existence of the in- 
variant measure is the most difficult property to establish. This is in sharp contrast 
with equilibrium where the invariant measure is given, a priori, by the usual Gibbs 
Ansatz. Also as we prove the existence of an invariant measure we prove strong 
ergodic properties which, of course, are also of interest at equilibrium. The idea 
is to construct a Liapunov function for the Markov process x{t) (for a detailed 
exposition of the subject see j28| ). For this problem we proved the following. Fix 
t > Q and 9 < (max{Ti, T„})~^ and consider the function We{x) given by Eq. H23|l . 
There exist a constant Eq and functions k{E) and b{E) defined on [Eq,oo) with 
hniE^oo i^{E) = Osuch that for E > Eq 

(28) T'Weix) < K{E)We{x) + b{E)x{G<E}ix). 

This means that, outside the compact set {G < E}, the dynamics is dissipative and 
since k{E) tends to zero as E tends to infinity, the dissipation at high energies can be 
made arbitrarily strong. This particular property of the Liapunov function together 
with the smoothness of the transition probabilities implies that the semigroup T* 
is compact on the Banach spaces He- 

One should think of the dynamics as follows: to the conservative Hamiltonian 
dynamics two forces are added, a dissipative force (the terms —jri in (|19|l ) and 
a random force (the white noises) which are proportional to the temperature. At 
high energies, i.e., at energies much bigger than the temperatures of the reservoirs, 
dissipation dominates and there is a strong drift which let the energy of the system 
decrease and the fluctuating forces are negligible compared to the dissipation. At 
low energies, on the contrary the fluctuations are not dominated by the dissipation 
anymore. 

Since both dissipation and noise act only at the boundary of the chain, a key 
ingredient in the analysis is a bound on propagation of energy in anharmonic lat- 
tices. Think for example of an initial condition in which the energy is concentrated 
in one oscillator far away from the boundary. To prove Eq. (|28|) one must have a 
lower bound on how much of the energy propagates through the chain to the bound- 
ary to get dissipated. For this bound the condition H2 is crucial. It is well-known 
|40L I25L l3] that in networks of anharmonic oscillators there are breathers which are 
(Nekhoroshev-stable) time periodic exponentially localized solutions of the Hamil- 
tonian equations of motions. A simple scaling argument shows that the high energy 
behavior of breathers is very different depending on whether the condition H2 is 
satisfied or not. If it is not satisfied, the higher the energy, the more localized the 
breather tends to be: at high energy we can have states with oscillators oscillating 
very fast and barely interacting with their neighbors which are essentially at rest. 
On the contrary, if Condition H2 is satisfied, then one can show that for any initial 
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condition of sufficiently large energy E, the kinetic energy of the oscillator on the 
boundary will be at least of order E"^/^^ on a time interval of order 1. 

To prove (|28|l . in a first step one sets Ti = r„ = in H19|) and one obtains a 
set of deterministic ODE's equations. Using the bound on propagation of energy 
one shows that for large enough G'(O) = E we have 

(29) G(l) - G(0) < -c£;2/fc2 _ 

Note that this corresponds to the physical situation where the reservoirs, at time 
t = are at energy 0. In this case the system simply radiates all its energy 
into the reservoirs and relax into a state corresponding to a stationary point of the 
Hamiltonian H. If the temperatures are non-zero, one shows that on a suitable time 
interval the random solution of H19|l do follow closely the deterministic trajectories 
with very high probability. So for most trajectories, an estimate of the type H29I) also 
holds. To conclude of the proof of H28fl . one considers the function Wg — exp {9G) 
and uses some stochastic analysis (see |31) for details). 

4. Heat Flow and Entropy Production 

To define the heat flow and the entropy production we write the energy of the 
chain iJ as a sum of local energies H — X]r=i '^here 



H 



(30) = ^ + u^'Hq^) + l{u'^^\q^-l-q^) + u^'\q^-q^+l)) , 

Hn = ^ + U^'\qn) + \u^^\qn-qn-l). 
Differentiating with respect to time one finds 

(31) ^T*i/, = T*($,_i - $,) , 
where 

$0 = -Aripi , 

(32) = (^i^!±ilvC/(^)(g,-g,+i), 

$„ = \rnPn ■ 

It is natural interpret ^i, i — 1, • • • ,n — 1 as the heat flow from the i*^ to the 
{i + 1)*'* particle, $o as the flow from the left reservoir into the chain, and $„ as 
the flow from the chain into the right reservoir. We define corresponding entropy 
productions by 

(33) -=(^-^)*- 

There are other possible definitions of heat flows and corresponding entropy pro- 
duction that one might want to consider. One might, for example, consider the 
flows at the boundary of the chains, and define at = ^i/Ti — $„/r„. Also our 
choice of local energy is somewhat arbitrary, other choices are possible but this 
does not change the subsequent analysis. 

Our results on the heat flow are summarized in 
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Theorem 4.1. : Entropy production 

(a) The expectation of the entropy production Uj in the stationary state is indepen- 
dent of i and nonnegative 

(34) J ajdfi > 0, 
and it is positive away from equilibrium 

(35) / ajdiJ, — if and only if Ti = T„ . 



(b) The ergodic averages 



(36) - a, (x(s)) 



satisfy the large deviation principle: There exist a neighborhood O of the interval 
[~ J ajdfi^ J CFjdfi] and a rate function e{w) (both independent of j) such that for 
all intervals [a,b] C O we have 

(37) lim -ilogP,{a,* e [a,6]} = inf e(u;) . 

t-*oo t w£[a,h] 

Moreover the rate function e{w) satisfy the relation 

(38) e{w) — e(— w) = —w , 
i.e., the odd part of e is linear with slope —1/2. 

Let us consider the functions Rj given by 

(39) R, = ^ [Y + i^'^^P^A+jri E H,{p,q) + - 

\ k=i / " yfe=j+i 

SO that exp(— i?j) is a "two-temperatures" Gibbs state. We denote by J the time 
reversal operator which changes the sign of the momenta of all particles Jf{p, q, r) = 
f{—p, q, r) and we denote as the formal adjoint of the generator L (the Fokker- 
Planck operator). The following (formal) operator identities are easily verified 

(40) e"'UL^Je-^'=L-aj, 
and also for any constant a 

(41) e~^'J{L^ - aaj)Je"' = i - (1 - a)aj . 

These identities are the key element to prove both Eqs. (|34|l and 1)38(1 . The fact 
that the entropy production is strictly positive away from equilibrium do require 
more work 

Let us sketch the proof of Eqs. We write the positive density p{x) of 

fj,{dx) = p{x)dx as 

(42) p^Je-^'e-^'. 
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Let L* denote the adjoint of L on L'^in), it is given hy L* — p ^Lp and using Eq. 
(|4()|l a simple computation shows that 

JL*J = e^'{L-Gj)e-^^ 

(43) = L-aj -{LFj)-2 ^ Tiiyr^Fj)^^, 

ie{l,n} 

ie{l.n} 

The operator JL*J is the generator of the time- reversed process and using that 
L*l = we find the identity 

(44) = T,\VrM^-LF,. 

ie{i,Ti} 

The first term is obviously positive while the expectation of the second term in the 
stationary state vanishes and so we obtain Eq. 

Let us turn now to Eq. H38|l . Let us give first a formal proof, ignoring any 
technicality (the argument is essentially from 22 ). To the study of the large devi- 
ations the large deviations of t^^ ai{x{s))ds we consider the moment generating 
functionals 

(45) r^(t,a) = [e-"i'o'^'(^("»'*" . 

Formally the Feynman-Kac formula gives Tl{t,a) = e*(^-"'"')l(a;) and the large 
deviation functional e{w) is given by the Legendre transform of the function 

(46) e(a)= lim -ilogr^(i,a). 

t^oc t 

By a Perron- Froebenius argument e(a) is the largest eigenvalue of L — acr^. Since 
L — aoi is conjugated to — (1 — ci)<7i by Eq. \W\ and since L — aai and — aai 
should have the same spectrum we conclude that e{a) — e(l — a). Taking Legendre 
transform we obtain Eq. 

How do we make this argument rigorous? From the form of the entropy pro- 
duction a (it is an unbounded function), one sees that L — aai is not a relatively 
bounded perturbation of L. A priori it is not even obvious L — aai is the generator 
of a semigroup, i.e., that the function Tl.{t,a) is finite for a ^ 0. To make things 
work we will use the following identity which can be checked easily 

(47) L-aa^ = e^^'Lae'"-"' , 
where 

(48) la = i + 7 J2 - {a- a^)Tr\^) + 2d-/a . 

ie{l,n} 

This shows that all the operators L — aai are conjugated to the same operator ha- 
lt is not hard to see that La is relatively bounded perturbation of L. Using the same 
techniques as the one used in the proof of Theorem l3 . 1 1 one can show that exp {tLa) 
defines a quasibounded compact semigroup on Tig provided that —a < 6Ti < 1 ~ a 
and using Eq. H48|l this shows that the function e(a) exists and is real analytic 
provided 

'J. rn i n 'J. rni n 
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Using Gaertner-EUis Theorem concludes the proof of Theorem 14. II 

Remark 4.2. Time reversal and entropy production I. It is instructive 
to give a interpretation of Eq. (|43() in terms of the path space measure of the 
process (see |26| ). At equilibrium (Ti — Tn = T) this is simply detailed balance, 
Ri = G, JL*J = L OT pt{Jy,Jx) = pt(x, y) exp (-(G(?/) - G{x))/T). If we are 
away from equilibrium we can interpret it as follows. Let Pgt denotes the path 
space measure of the stationary process starting in the state fi and let 9 denote 
the operator defined by 9x{t) = x{—t). The path space measure of the (stationary) 
time reversed process is given by P^^"" — JPst ° 9"^ and its generator is JL*J. 
Using the relation H43|l and Feynman-Kac formula we find 

(50) {x{t)) = er ^a X e"(^^(^(*))"-^^(^(°))) . 

dPst 



As pointed out in |26| , this gives a microscopic definition of the entropy production 
and relates it directly to the action of time-reversal. 

Remark 4.3. Time reversal and entropy production II. If we go back to 
the original Hamiltonian description of the system, we note that the dynamics and 
the in ital conditions of the reservoirs are invariant under time reversal: changing 
t into —t, and changing the signs of the momenta p of the crystal and of the fields 
n leaves the equations of motion unchanged. Also the initial condition of the 
reservoirs are distributed according to the Gibbs measure and are invariant under 
reversal of the velocities in the reservoirs. Consequently we can study the behavior 
of the system as t ^ —oo simply by changing p into —p, tt into — tt and considering 
t ^ oo. If we do this and reduce the dynamics as in the section [3 we obtain a 
Markov process with a generator given by JLJ (the variables r are left unchanged) 
and the system relaxes into the stationary state Jfi. 

Since aj is an odd function of p, we have / ajd^ < 0. One might be tempted 
to draw the conclusion that, in the far distant past, heat was flowing from the 
cold reservoir into the hot one. This is incorrect since the very definition of the 
heat fiows involves a time-derivative, if we consider t — > —oo one should change the 
definition of the flows accordingly. 



Remark 4.4. Green-Kubo formula. As noted in |15U22| one can derive the 
Green-Kubo from the fluctuation theorem. Here the external "field" is the inverse 
temperature difference A/3 = (/3„ — /3i) and we have aj — Af](j>j. We consider the 
function /(a, A/3) given by 



(51) /(a,A/3)= lim -ilogE^ 

t~^oo t 



-a 4>i {x{s)) ds 



where a = aA/3 and the second variable in / indicates the dependence of the 
dynamics of the stationary state on A/3. From the compactness properties of the 
semigroups involved it is easy to see that /(a, A/3) is a real-analytic function of 
both variables a and A/3. The relation e(a) = e(l — a) now reads 

(52) /(a, A/3) - /(A/3 -a, A/3). 

Differentiating this relation we find 
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We have 
(54) 

(55) 



{T^(f>j)(f>jd^io ] ds, 



where Tq is the semigroup at equihbrium (A^ 
measure exp {—f]G). We obtain 



(56) 



d 



(pjdji 



A/3=0 



0) and /ig is the equihbrium 



{T*(j)j)(j)jdiJ ) ds , 



and this is the famihar Grecn-Kubo formula. 



5. Langevin equations and other lattice of oscillators 

5.1. Hypercubes. The reader may wonder why we are only considering one- 
dimensional lattice of oscillators. Although it is not difficult to construct Hamilton- 
ian models of higher dimensional lattice of oscillators interacting with reservoirs, 
the reduction to a tractable set of SDE's is not trivial. In particular it is not easy 
to prove that reservoir provide enough noise/dissipation to carry the analysis done 
to prove Theorem 13. II 

If we consider hypercubes of oscillators and stochastic reservoirs given by 
Langevin equations much can be said. For i G Z'^, let \i\ = sup]^<j, < \ik\ and 
let A be the hypercube A = {i G Z'' , \i\ < N}. The side of the cube TV is arbitrary, 
but finite. On each site of A there is an oscillator with coordinates {pi, qi) G R'' x R'^ 
and the Hamiltonian of the system is given by 

(57) F(p,g) = ^ I | + [/(i)(5,)+ ^ U^^\q,-q,) 

l£A \ jeA: \j~'l\ = l 

As a model of reservoirs add an Ornstein-Uehlenbeck process to each oscillator on 
two opposite sides of the hypercube A. The equations of motions are 

Qi = Pi , 

(58) dp, = (-Vg.y(g) - Ak) dt + v/2ATidw, , if h = -N , 

qi = Pi, 

(59) dp^ = {-Vq^V{q) - \pi) dt + ^/2\TRduj, , ifzi = 7V, 

ii = Pi , 

(60) - -Vg.y(g), ifHy^-N,N. 

We denote by x{t) = {p{t),q{t)) the Markov process which solves Eqs. I|58|) - (|6U|I . 
We have, similarly to Theorem l3.1l 

Ergodic properties: The Markov process x{t) has a unique invariant measure /i. 
The measure ^ is ergodic and mixing and has a C°° everywhere positive density. 
The convergence to the stationary state occurs exponentially fast. 

We can also prove a result analogous to Theorem 14. II bv considering the heat 
flow through an hypersurface {ii = k}. We define the energy of the oscillators in 
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the hyperplane {ii — k} to be 



i:il=k \ jeA: ji=k,\j-i\ = l j 

then the total heat flow <i>fc between the hypersurfaces \i\ — /c} and {«i = /c + 1} is 
given by 

(62) ^^-Y. P'+f+-- V^(^)(g.-g.,+.J, 



2 

z:zi —h 



where ei = (1, 0, • • • , 0). The corresponding entropy production is defined by crfe — 
{T^^ -Tj~^)<^k- As in Section g^l we have 

Positivity of the entropy production: The expectation of the entropy produc- 
tion CTfe in the stationary state is independent of j and nonnegative 



(63) J akdfi > , 
and it is positive away from equilibrium 

(64) J (Tkdii = if and only if Ti = T„ . 

Gallavotti-Cohen fluctuation theorem: The ergodic averages 

(65) <Jk{x{s)) 

obey the large deviation principle with a rate function e{w) which satisfy the rela- 
tion 

(66) e(w) — e{—w) = —w. 



The techniques used to prove Theorem 13 . II can be used to analyze Eqs. (jS^ 
(I60II . To see this just think of the set of all oscillators on the hyperplane ii = fc as 
one (2L 4- l)''^ ^-dimensional oscillator Qk with one-body potential 

(67) w^'HQ,)= E E u'^'Hq.-Qj), 

i : ii—k i,j : ii—ji—k 

and two-body potential 

(68) W^^^Qk - Qk-l) ^ E U^^\q,-qj). 

i^j : ii—k,ji—k — l 

Doing this we obtain a "chain" of (high-dimensional) oscillators. The noise and 
dissipation are slightly different, but this can be analyzed using exactly the same 
methods. 
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5.2. General Graphs. A natural problem, considered in |27L I42| . is the 

following. Consider an arbitrary graph G = {V,E), at each vertex i of G there 
is an oscillator with coordinates {pi,qi) and energy + U^^^qi) and for each 
edge e € E between i and j the two oscillators interact via a two-body potential 
U^'^\qi ~ qj). The boundary of the graph is a subset dV of the set of vertices V 
and if z e dV , an Ornstcin Uchlcnbeck modeling the interaction with the reservoir 
is added to the Hamiltonian equation. 

Given such a graph, one might ask under which condition on the graph the 
analysis done for the chain can be carried over. This is largely an open problem 
but the following can be said 

Quadratic potentials: If the potentials are quadratic, then the SDE's are linear 
and necessary and sufficient conditions are known for the existence and uniqueness 
of stationary states. It can be given in purely algebraic terms, see e.g. j20j . 

Nonuniqueness of the stationary state: On the other hand, linear models 
have (too) many invariants and very simple model have more than one invariant 
measure, e.g., four harmonic oscillators arranged in a diamond shape with two op- 
posite oscillators connected to heat baths have a one-parameter family of invariant 
measures 42 , 2^ ■ 

Entropy production: The nonnegativity of the entropy production is very easy to 
establish at the formal level. Let R be the function given by i? = J2iedvi'^i)~^Pi /"^ 
where Ti is the temperature of the reservoirs attached to the oscillator i. We 
have the relation e^JL'^je^^ ^ L - a, where a = Y.iedv'^i'^iPi - ^0- The 
quantity is {Ti — Pf ) is to be interpreted as the heat flow from the system into the 
corresponding reservoir at temperature T^. As in section f4.1l one shows that this 
relation implies the nonnegativity of the entropy production in the stationary state. 
Using conservation laws other entropy productions involving heat flows through the 
bulk of the lattice can be considered too. 

Positivity of the entropy production: In ^27' an interesting condition is given 
which implies the positivity of the entropy production, provided one assumes the 
existence of a smooth positive stationary state. As mentioned above, if the elements 
of a graph are connected to many others, the potential should be "sufficiently" 
non-linear. The condition is the following: a function / is called n-nondegenerate 
provided the set 

(69) W = {(gi, • ■ • ,g„) e R" : 3{q[, ■ ■ ■ ,q'^) e R" : det{f{ql - q,)) ^ 0} , 

is dense in R". For example the polynomials of degree r are n-nondegenerate 
provided r > n — 1. One can show (|27| for details) that if cP'U'^2)/dq^ IS n- 
nondegenerate for n sufficiently large then the entropy production is non-negative. 
How large n should be depends on the graph, in particular on how many nearest 
neighbors an oscillator has and if there are many loops in the graph. We conjecture 
that such a condition should also imply existence and uniqueness of the stationary 
state. 
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